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netrexxi 


Overview 


■ Introduction to NetRexx 

■ Demo. -- compiling and interpreting 
NetRexx programs 

■ The compiler/interpreter implementation 


Questions? 



What is NetRexx? 


■ A complete alternative to the Java 
language, for writing classes for the Java 
Virtual Machine 

■ Based on the simple syntax of Rexx, with 
Rexx decimal arithmetic 

■ Fully exploits the Java object model, 
exceptions, and binary arithmetic 

■ Automates type selection & declaration 

■ Removes many historical quirks 


Java is a trademark of Sun Microsystems Inc. 


The Rexx language family 


'Classic' Rexx 


Object Rexx NetRexx 

OS/2 L- javaVM 

Win32 

Linux 

AIX 



NetRexx Java implementation 


■ Current implementation first translates 
NetRexx to accessible Java source, or 
interprets it directly (or both) 

■ Runs on any Java platform 

■ Any class written in Java can be used 
-GUI, TCP/IP, I/O, DataBase, etc. 

■ Anything you could write in Java can be 
written in NetRexx 


... and it's free. 





NetRexx programs 


toast, nrx 


/ * Thi s w s Kies you good heal * h- 


*/ 



Control constructs 


i f ansvuer — yes' t hen say 1 OK! 1 


el se say 1 shucks' 


I oop i =0 for rvyst ri ng. I ength 
say i 1 nyst r i ng[ i J 

end i 


also do.. end for simple grouping, with 
label for i ea Ve 



Control constructs - select 




v\hen X, 2 then say 1 snal I 1 


end 


(The usual Rexx select without case 
is also supported, and select may 
have a label) 



Strings - the base type 


■ Strings in NetRexx are of type Rexx 

- by default, data and numbers are strings 

- standard methods from Object Rexx 

- conversions 

■ Automatic inter-conversion with Java String 
class, char and char[ ] arrays, and numeric 
primitives (optional) 


Arithmetic 


■ Preferred arithmetic is from ANSI Rexx 

■ Decimal, just one type of number 

-follows human rules (2 * 1.20 is 2.40) 

-gives exact results when expected ( e.g ., 
for 0.1,0.3) 

- no overflow at binary boundaries 

- arbitrary precision 


numeric digits 300 



Binary classes and methods 


■ The binary keyword instructs the compiler to use 
native (binary) arithmetic types and operations 
(boolean, byte, int, long, float, etc.) 

■ Achieves the full speed of the Java Virtual Machine 
and JIT compilers 

■ No performance penalty for using NetRexx instead 
of Java 


Explicit typing 


■ Casting/conversions use the blank 
(concatenation) operator 

nuriber =i nt 7*y — nuriber i s an i nt 

nunber 2=i nt — var i abl e dec I arati on 

■ Consistently extends to method arguments 


net hod si ze( x=i nt, y=i nt, dept Ki=i nt 3) 



Other features from Rexx 


■ Case-insensitivity 

■ Parse 

■ Trace (methods, all, results) 






Exceptions 


■ Semantics from Java 

■ Generalized and simplified syntax (extends 
all existing control constructs) 

say 1 Rl ease enter a nurtber: 


cat c h Except i on 

say 1 Sorry, coul cfl not cfli vi cfle 1 - 
111 nunber 1 11 i nto l 1 


ncfl 


NetRexx JavaBean support 


■ JavaBean (indirect) properties 


generates (or checks): 


net hod get Fi I I i ng ret ur ns j ava. avt. Col or 
return f i I I i ng 

net hod set Fi I I i ng( $l=j eve. av\t. Col or) 
f i I I i ng=$l 


NetRexx Inner Class support 


■ Minor and Dependent classes 

cl ass Foo 
x=Bar() 

y=Foo. Bar nul I 
z=? Hel I o 1 
x. Gourit er 


cl 



Bar 



Count er 


extends Another 


say 


par 


ent. 






Demonstration 










So how does it work? 


■ Unconventional organization 

■ Structured like an interpreter rather than a compiler 

■ Parsing is not carried out 'up front', but on demand 

■ Parsing is identical for translation to Java or for 
direct interpretation, with full error checking at the 
point of parsing 


Overall translator organization 


T ranslator -► Classer 

1 





Streamer 



T okenizer 


Babelizer 


Expressions 


Variables 

















Overall translator organization 


F ranslator 


1 


Classer 



VI 


Streamer 



T okenizer 


Babelizer 


Expressions 


Variables 





















T ranslator 


Internal API for NetRexxC to use 
Factory, language, and programs setup 
Cross-program pass control (3 main passes) 
Manages compilation using javac 
Manages interpretation 
Top-level error handling 



Overall translator organization 



Classer 


Tokenizer 


Streamer 


Babelizer 


Term parser 



Expressions 


Converter 



Variables 















Classer 


■ Most difficult area of translation, due to changes in 
Java core over time 

■ In general 'owns' the external namespace 

■ Manages class path, ambiguous classes, etc. 

■ Locates, reads, and parses class images 

■ Locates methods and properties, based on costing 
algorithm 


Overall translator organization 


T ranslator -► Classer 

1 





Streamer 



T okenizer 


Babelizer 


Expressions 


Variables 

















Token izer 


■ One of several shared resources 

■ Language-independent tokenizing of an input 
stream or array of character arrays 

■ Other shared resources include: 

-error message editor 

-base internal types (Tokens, Flags, Types, etc.) 
-trace code generator 

-interfaces (ClauseParser, ProgramSource, etc.) 


Overall translator organization 


T ranslator -► Classer 


1 


Program 


T 

Parse 

control 

Clause 

parsers 


Streamer 


Term parser 


T okenizer 


Babelizer 


Expressions 


Converter 


Variables 







Program 


■ Represents exactly one of the programs being 
translated 

■ Each program may be in a different language, with 
different syntax (and different semantics at the 
statement level) 

■ Holds program-level objects (streamer, package 
information, imports, options, etc.) 


Overall translator organization 


T ranslator 

1 



Clause 

parsers 



Classer 


Tokenizer 


Streamer 


Babelizer 




Term parser 



Expressions 



Converter 



Variables 

























Streamer and Babel izer 


■ Streamer handles input and output streams 

-locates input files 
- names and creates output files 
-checks for conflicts 
-reads files on demand 

■ Babelizer converts internal representations to 
viewable strings, depending on the language 

-associates file extensions with languages 
-arrays shown as or or , 

-attributes spelled as appropriate for the language; 
e.g., shared or Friend 


Overall translator organization 


T ranslator 


? 


Classer 



VI 


Streamer 



Term parser 


T okenizer 


Babelizer 


Expressions 


Converter 


Variables 


















Parse control 


■ State machine for static parsing 

■ Language-dependent (hence one instance per 
program) 

■ Three levels of parsing, deferred where possible: 

-parse Prog ram 
-parseClassBody 
- parseMethodBody 

■ Parsing-related utilities (pushLevel, popLevel, etc.) 


Overall translator organization 


T ranslator 

1 


Classer 



VI 


Streamer 



T okenizer 


Babelizer 


Expressions 


Converter 


Variables 












Clause parsers 


■ Each knows about a single clause in one language 
(Do, Catch, End, Nop, Say, etc.) 

■ Each has a scan method (lexical parse) 

■ Each has a generate method, for Java code 

■ Each has an interpret method 

■ generate and interpret share information gleaned 
during scan (which may have been multi-pass) 


Overall translator organization 


T ranslator -► Classer 

1 





Streamer 



T okenizer 


Babelizer 


Expressions 


Variables 


















Term and Expression parsers 


■ Recursively call each other to parse terms and 
expressions. For example: 


< Rexx vector, get: ( 1 key' > ) . subst r ( i +1, j ) 


■ Term parser is more complicated than Expression 
parser, and is easily the largest class in the 
translator (100K characters, including comments) 

■ Like clause parsers, both can emit Java code or 
execute (interpret) the term or expression 


Overall translator organization 



T okenizer 


Babelizer 


Expressions 


Converter 


Variables 



















Converter and Variable manager 


■ Converter understands type inferences 

-costs conversions (used for method finding and error 
checking) 

-effects conversions (emits Java code or interprets) 

■ Variable manager handles both class and method 

variables 

-All properties and local variables during scan passes 

-Only static (Class) properties and local variables during 
interpretation - instance properties are held in a real 
object 
















































General principle 


■ First, programs are parsed (to determine classes, 
properties, and methods with their signatures) 

■ For each class, a proxy (stub) class is created 

-this has all the properties just as in a 'real' class 
-for each method, it has only the definition and return 

-when a method is invoked through Java reflection, it 
immediately calls the interpreter, which interprets the 
method body 

■ Real instances are created, so interpreted classes 
are visible to the JVM for callbacks, etc. 







































Interpreter 


■ Primary task is interpreting method bodies, by 
finding each clause in turn and invoking its 
interpret method 

■ When class first used or instance constructed, 
interprets initialization code (properties, etc.) 

■ Handles Java reflection (access to real properties, 
instances of objects, arrays, etc.) 


Interpreter complications 


■ Signals - have to be wrapped, and cannot be 
passed through a reflection call 

■ Constructors - arguments to super(x, y) call must 
be interpreted, then the super(x, y) call must be 
made by the proxy class, and only then can the 
constructor method body be interpreted 

■ Protected (synchronized) blocks of code must truly 
be protected to be thread-safe 


Interpretation 


T ranslator 


Interpreter 


Loader 
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Program 

I | 


i 

i 



Parse 

control 






Clause 

parsers 






Proxy class 


■ Builds a binary class image (in a byte array) for a 
class that is to be interpreted 

■ Tedious but relatively straightforward - the code for 
every method is essentially the same 

-collect arguments (wrapped if necessary) into an Object 
array 

- invoke the interpreter to interpret the method body 

-get the returned Object; unwrap or cast it as required, 
and return it 











































Proxy class Loader 


■ A Java classloader is needed to actually load a 
class into the JVM 

■ If the built-in one were used then a class could 
never be redefined; classes are only unloaded 
when the object that loaded them is unloaded 

■ Complication: we also have to load any external 
(compiled) private classes, as otherwise they 
appear to be in a different package and hence 
would not be accessible when they should be 


Summary 


A blend of Rexx and Java 
-scripting and application development 

- a truly general-purpose language 
Both decimal and binary arithmetic 
High productivity and simplicity 
-Java source is typically 35% bigger 

- Interpreter greatly speeds development 
Designed for users, not compilers. 


http://www2.hursley.ibm.com/netrexx/ 



Strong typing doesn’t need extra typing 







